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FOREWORD 



Dr. J. A. Davis in the Introduction which follows has 
captured both the spirit and quality, not only of this third 
conference on "educational development in higher 
educational institutions, but even more important the 
mission and strategies of the Regional Education Laboratory 
for the Carolines and Virginia in its efforts to promote 
constructive innovation and change in individual colleges and 
universities and in state departments (or councils) of higher 
education, based on the findings of research and on the 
implementation of new technologies. 

RELCV believes that innovation and change in individual 
colleges and universities must be aimed ultimately toward the 
improvement of the educational experiences of their 
students; but, it also believes the college's influence on the 
student can be enhanced greatly by the improvement of 
institutional processes from which new curricula and new 
instructional technologies emerge. RELCV also believes that 
the best educational decisions emerge from facts, on the one 
hand, and from a genuine partnership of students, faculty, 
administrators and trustees on the other. Hence, the rationale 
for RELCV's initial interest in institutional research, in 
institutional planning and decision making, and in applying 
the new technologies (many computer-assisted) to the 
processes of institutional analysis and decision making before 
directing major attention to the more important matters of 
curriculum and instruction. Only when sufficient information 
is known about the characteristics of the students attending a 
particular institution, the characteristics of the faculty and 
the administration, the purposes of the institution, and the 
climate for learning that has already been established, is it 
fruitful to embark upon such objectives as curriculum 
reforms, instructional improvements, or major changes in 

institutional policy. . 

May I express again my deepest appreciation to Dr. Davis, 
to his colleagues at the Educational Testing Service and to 
the officers of the Educational Testing Service at Princeton 




i 



for their invaluable contribution to the early development of 
the Regional Education Laboratory for the Carolinas and 
Virginia. Persons who have not been intimately involved in 
the birth and unstable infancy of such an agency— charged 
with a new role in the educational system of both the region 
and the nation-will neve.* know of the difficulties, obstacles 
and uncertainties that had to be dealt with. For his constant 
help on both trivial and substantive matters, we express our 
deep appreciation to Dr. Davis. 

Everett H. Hopkins 

President, RELCV 
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INTRODUCTION 



The essays included in this monograph are drawn from 
presentations at the third of a continuing series of workshop/ 
conferences sponsored by the Regional Education 
Laboratory for the Carolinas and Virginia and held in 
Durham, North Carolina, June 27-30, 1968. This series is 
directed specifically toward the development of new 
processes for incorporating higher education research into 
long-range planning and innovation in institutions of higher 
education, and of a new role for a senior staff member of the 
college or university who must contrive and execute useful 
but rigorous research, and who must communicate and 
diffuse the findings in such ways that effective long-range 



planning may be initiated or facilitated. 

The germ of the idea for the larger activity of which these 
workshops are a part grew out of discussions in 1966 led by 
Everett Hopkins, then chairman of the higher education task 
force for RELCV, and which included John Lavach and 
Robert Simpson, then of the office of the vice president for 
regional programs at Duke University; a nine-man advisory 
committee from North Carolina, South Carolina, and 
Virginia; Drs. John Centra, J. A. Davis, Rodney Hartnett, 
Robert Linn and Richard Peterson of the higher education 
research group at Educational Testing Service; and, Dr. 
Robert Stoltz, director of the southeastern regional office of 

the College Entrance Examination Board. . . . . . 

This group took early note of the routiness with which 

many of the conventional institutional research officers 
conduct studies, and the frequent absence of relevance for 
specific institutional problems in the work of discipline- 
oriented social scientists who concern themselves with one or 

another aspect of higher education. , . 

Toward the establishment of new models and roles for 
what has since been named the "Educational Development 
Officer," the following assumptions were formulated: 

(1) The individual charged with conducting 
institutional studies should be a senior 
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academic officer, responsible directly to the 
president of his institution; 

(2) He must be capable of taking a serious, 
mature and perceptive view of the tasic 
problems of higher education; 

(3) He must be able to stand high in the 
regard and respect of the best, concerned 
faculty members of his institution; 

(4) He must have adequate released time for 
his research mission, both to formulate and 
conduct relevant research and to place the 
findings in channels for action; 

(5) He must possess or acquire a reasonable 
•skill in the several methods of social science 
research (e.g., the methods of historical 
analysis, of empirical investigation, of 
quantitative or statistical design, etc.), that his 
work may be sharp and its limitations or 
qualifications known to him; 

(6) He must accept, as the ultimate test of 
the educational process, the evidence of 
impact of the institution on the student and 
staff; this requires an interactional focus on 
input, process, context, output and 
consequence factors; 

(7) He must be helped in determining 
modern resources-of previous studies, 
instrumentation, data processing— that may be 
useful in defining relevant problems for his 
attention and the alternate strategies and 
attacks on these problems that he can 
employ. 

In this view, the further assumptions are implicit that few 
prototypes for this role now exist, and that continuous, 
informed and directed local study is needed for institutional 
planning and innovation. As the prime mission of RELCV has 
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been established as the development of models for contriving 
the innovation and change processes that assure institutional 
vitality, an activity for establishing the role and aiding in the 
development of persons to fill it promised to afford an 
avenue for the determination of useful research and for 
formal study of the dynamics of institutional development. 
Therefore, as an integral component of its larger program, 
RELCV did initiate, in the summer of 1967, a three-year 
activity for the training of the proposed new breed of 
educational development officers, and for exploring with a 
discrete group of participants the effective translation of the 
findings of higher education research into action. 

College and university presidents in the three-state area 
were invited to nominate qualified individuals for 
participating, along with themselves, in the formal series of 
activities designed to establish the mission of informed and 
continuous improvement of their respective institutions. 
Criteria used in selecting institutions from among those 
making formal application for membership in the consortium 
focused on: (1) availability of an individual high in the 
regard of his president and faculty members, with strength in 
his discipline, and with sufficient released time for in-service 
training and for the conduct of institutional studies; (2) 
commitment of the president to the program; and (3) (to a 
lesser extent) a sufficient spread of institutional types and 
categories of institutional problems to assure reasonable 
ingredients for RELCV's basic mission of developing models 
for the institutional innovation and change process. 

The first workshop, held at Montreat- Anderson College in 
the summer of 1967, followed a briefing b" and to the 
presidents of 18 colleges represented. Led by Drs. Rodney 
Hartnett and John Centra (acting as RELCV staff), and 
supported by special access to consultants such as Dr. Joseph 
Saupe of Michigan State and vice president Stanley Ikenberry 
of the University of West Virginia, the instructional content 
of the sessions fell into two major categories: the substance 
of the concerns of higher education in the United States and 
the essential principles and techniques of social science 
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research. An ambitious schedule of readings, a number of 
institutional case studies, some role-playing exercises and 
spirited give-and-take marked the first two weeks of this 
workshop. In the third week, each institutional representative 
was provided with a plan for a carefully formulated core 
program of re^arch focusing on exploring, over time, the 
growth and development of one class of students in the 
context of augr. tented information about the learning 
environment. In addition to establishing the ground work to 
permit this core study to be conducted in common by the 
participants, further individual attention by workshop staff 
was directed toward helping the institutional representative 
contrive other particular studies (either unique inquiries or 
specific embellishments on the core study) that represented 
for him crucial concerns at his own institution. 

Accordingly, the representatives returned to their 
campuses and initiated, in the fall of 1967, the basic data 
collection required by this plan. In addition to information 
about students already routinely collected, most of the 
institutions added the informetion on student backgrounds, 
attitudes and aspirations provided by the College Student 
Questionnaires , Part I. Several institutions also administered, 
toward a before-and-after design, the brief subject matter 
achievement tests of the Survey of College Ability. 

The second workshop, held at mid-year of the 1967-68 
academic year at the Quail Roost Conference Center in 
Rougemont, N. C., had several important goals. One was to 
begin a formal joint examination of the specific findings in 
the individual institutional studies started by the participants, 
toward helping each participant to augment his experience 
with that of the others, to increase his inventory of 
researchable problems and to deepen his perspectives of the 
implications of his own data. Six of the representatives aided 
earlier by RELCV consultants who had visited their campuses 
presented descriptions of specific findings, or of their larger 
developing programs. 

A second major goal of the mid-year workshop was the 
initiation of explorations of ways in which findings could be 
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diffused into the mainstreem of institutional planning, and in 
which the ongoing research could, without prostituting 
honorable methodology, be better directed to real problems. 
The keynote address by Dr. James Montgomery (a past 
president of the Association for Institutional Research) was 
directed toward this matter, and was subsequently invoked 
by staff and participants into their consideration of what 
they had found or might find in later work. 

Some minor time was also directed to an overview of 
modern data processing methods and resources either toward 
helping representatives to utilize resources of their own or 
near-by institutions, of anticipated computer capabilities of 
RELCV or of national resources such as those of the College 

Board Validity Study Service. 

Following the mid-year workshop, the institutions 
continued, with the occasional help of RELCV staff, their 
basic data collection and analysis program in the continuing 
core study. For most, this involved the follow-up 
administration of the second part of the College Student 
Questionnaires (to determine changes in attitudes and values 
of students over their first college year); the administration 
of the College and University Environment Scales (to examine 
students' perceptions of their learning environment); and, the 
collection of other perceptions of the college from 
administrators and faculty through the experimental 
Institutional Functioning Inventory. 

The third workshop, from which the papers for this 
monograph were selected, was drawn on the same premises 
and goals as those formulated earlier. Not only did most of 
the original workshop participants return, but many brought 
with them the natural cohorts from their faculty or 
administration who had amerged as they had proceeded with 
their studies. To maintain the centrality of the college 
president in the work of the participants from, colleges 
involved in the consortium, and to aid the presidents in 
understanding and utilizing the potentials of the RELCV 
strategy, these chief academic officers of the participating 
colleges also were invited. 
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The content of the third workshop was designed to permit 
aqain the cooperative review of the accumulated findings and 
to speculate on the implications and strategies to infuse 
findings into planning. However, to maintain the style and 
tone of the activity and to prevent the straying of attention 
to the more petty details of methods and technologies, a 
renewed emphasis on some contemporary problems of higher 

education was felt to be crucial. #J 

In the papers following, Dr. Kenneth Wilson, vice president 

for research of the College Research Center with offices at 
Vassar College, reflects the chronic and acute pangs of 
conscience of the educational development officer who is not 
only capable in his discipline of research, but also is very 
much concerned that his work be relevant to institutional 
needs and problems, and that he places the results in 
professional service to the continuing development of the 

institution. , . . 

Dr Gordon Blackwell's paper, drawn from an intensive 

investigation commissioned by the Southern Regional 
Education Board, reflects the hypothesis of the 
sociologist-turned college-president about probable crucial 
trends in higher education in the South over the next 20 

V6 A S trilogy of papers by Dr. Julian Foster (a political 
economist); Dr. William Van Alstyne (a professor of law) and 
Dr. William Craig (a specialist by training and past experience 
in student personnel administration, and by more recent 
experience in higher education generally) is devoted to those 
issues arising out of current student and faculty clamor for 
new kinds of participation in academic governance. 

One important ingredient of the conference, not included 
herein because it was planned more as a discussion than as a 
formal paper, was presented by Dr. Sharvey limbeck, 
president of Knox College and the current chairman of the 
American Council on Education. Dr. limbeck sketched the 
corporation model as a vehicle for describing how research 
may lead from institutional management problems to their 
solution. Dr. limbeck also provided a number of specific 
examples of how the research strategy or the conduct of 
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specific studies had contributed to the phenomonal 

development of his institution. 

This, then, is a part of the background and the context of 
the third RELCV workshop for educational development 
officers. The materials following are reproduced not so much 
in the impossible hope that the spirit, enthusiasm and many 
sterling contributions of the total body of participants could 
be captured, but rather as a record for those present who 
may have been too occupied with their own thoughts to have 
preserved, in detail, the excellent and thoughtful statements 

of the speakers. , . . ... 

One other comment is in order here. This has to do with 

the rather wonderful discovery that something real and 
positive beyond the original goals or the subtle half-hidden 
purposes of RELCV to develop models for planning and 
innovation had occurred. That is the highest order of 
professional camaraderie, mutual respect, and sustained 
interest in the other institutions' problems that has grown 
out of the experiment. Perhaps this is attributable to the 
repeated contact among participants, or their common core 
of research, or the high quality and variety of insights from 
the multi-discipline representatives, or the fact that they have 
accepted responsibly their freedom to run with their own 
problems, or the interest and active support of their 
presidents. The high quality of the following papers is 
matched by the high quality of thought with which they 
were received, and other groups may want to explore the 
essential lessons of the experiment. 



J. A. Davis 
Conference Director 
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Keynote 

Address 

Kenneth M. Wilson 

The value of research as an instrument for the management 
and improvement of educational Institutions and programs is 
today almost axiomatic. Relevant signs of the times include 
the emergence of a professional organization for individuals 
engaged in newly developing institutional research programs, 
an increasingly voluminous body of literature on educational 
institutional research and investment of funds by 
governmental agencies and foundations in programs of 
research on educational problems at all levels from nursery to 
graduate school. As one observer put it recently: 

Colleges across the land are instituting 
self studies at an unprecedented rate; officers 
of institutional research are becoming the 
newest feature in the organization charts of 
institutions of higher education; the United 
States Office of Education Bureau of 
Research budget is almost $100 million per 
year. The question for many is not whether 
research will imp r ove education, but when. 1 

Yet, I believe it is fair to say that most colleges and 
universities have neither developed viable rationales for 
institutional research programs on their own campuses nor 
made definite provision for conducting such programs. The 
concept of institutional research remains relatively 
unstructured. It currently embraces topics ranging from unit 
cost analysis and faculty load through problems of space 

1 K. Patricia Cross, "When Will Research Improve Education?", I7»e Research 
Reporter, Vol. II, No. 4, 1967 (Center for the Study of Higher Education, 
Berkeley, California). 
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utilization and resource allocation, to study of the validity of 
admissions decisions, assessment of institutional 
environments and evaluation of educational outcomes. 

You are already familiar with Henry Dyer's excellent 
analysis of divergent points of view about institutional 
research, an analysis which is worthy of frequent 
reexamination. 

Given the vast, unstructured, researchable domain 
suggested by the current range of potential research interests, 
it is understandable that institutional research has tended to 
resist succinct definition and that the basic dimensions of this 
field of endeavor are not clearly delineated. It is also 
understandable that the way in which research is carried out 
and the results assimilated vary markedly from one campus 
to another. It should be emphasized, however, that we know 
very little about the assimilation process except that it is 
rather complex. Moreover, we should not be astonished or 
chagrined to find, if we should presume to inquire, that most 
members of most college communities do not .have a 
clear-much less shared— conception of the nature . and 
potential value of what may be thought of as an institutional 
educational research and development function. (I would 
add, parenthetically, that we would probably find this state 
of affairs to be prevalent without regard to the presence or 
absence on a campus of an office or official bearing an 
institutional research-related title.) 

Common Threads Emerge ^ 

Despite the ambiguity and diversity which characterize the 
developing institutional research movement, however, certain 
common threads appear to underlie the emergence of an 
incipient institutional research function in institutions of 
higher education which traditionally have valued and 
promoted research and scholarship on problems defined at 
disciplinary levels but not on problems defined at a mission 
or institution-wide level. These threads include vastly 
increased pressures on institutions to develop and maintain 
efficient procedures and programs as well as the belief that 



2 Henry S. Dyer, "Can Institutional Research Lead to a Science of 
Institution?/' The Educational Record 9 Fall 1966, 452*466. 2 
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research can contribute to the alleviation of problems to 
solution of problems, if you will-and to development of 
improved procedures in education. 

In the nature of things, more attention has been given to 
analysis of problems of resource allocation (at institutional as 
well as state and national levels) than to systematic analysis 
of problems of educational assessment and evaluation. 
Problems of survival must be dealt with first. As Dyer has 
pointed out, institutional researchers ignore this fact of life at 
their peril. However, the importance of reliable knowledge 
about the educational process is also being 
acknowledged-knowledge about student attributes, 
educational treatments, associated outcomes; about the 
impact of the student on the college and vice versa; about 
what changes take place and what happens to students during 
their college careers and who or what is responsible; about 
the characteristics of our institutions. Concomitantly, there is 
increasing consideration of the potential value of formal 
procedures for identifying, measuring and studying the 
interaction of variables, both personal and situational, which 
affect the nature and the outcomes of the educational 
process. This is being encouraged by many external 
agencies-Educational Testing Service, centers for the study 
of higher education, admissions testing agencies and regional 
education agencies, among them RE LCV. 

Also contributing to increased interest in research 
approaches to educational problems is the fact that many 
colleges are being forced for the first time to examine 
critically their major reasons for being and to redefine (even 
to clarify) their objectives in the face of changing social 
conditions and economic pressures. Once the winds of change 
reach gale force, all institutions recognize the importance of 
reliable knowledge about themselves, their accomplishments, 
their potentialities and their limitations. 

All too often, however, they are faced at such times with 
essentially irremediable, unbridgeable "knowledge gaps," 
attributable in large part to the fact that over the years 
colleges have not maintained programs of research and 
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evaluation predicated on the assumption that presuppositions 
regarding institutional objectives, procedures, arrangements 
and accomplishments are (or should be thought of and 
treated as) hypotheses to be systematically tested rather than 
axioms requiring no verification in experience and no test in 
terms of observed consequences. 

Institutionalizing the Research Function 

By and large, colleges have relied on informal, highly 
personalized, unsystematic methods of observing and 
evaluating the educational process, and we have a very long 
way to go before gaining general acceptance in our college 
communities of the need for formal, organized research 
programs-for institutionalizing a research function, if you 
will, to be implemented as regularly and as faithfully as other 
institutional functions. 

Suffice it to say, despite the general compatibility and 
acceptability of the concept of systematic inquiry in 
academic settings, commitment to systematic inquiry into 
the educational process is still not widely shared and, as yet, 
there is no pervasive feeling within most college communities 
that conventional methods of generating answers to 
educational questions should be augmented or modified. 

In fact, those who have questioned essentially exclusive 
reliance on informal, conventional, personalized methods of 
knowing often have had little support from their colleagues 
and only limited success in their efforts to establish a 
research base for important educational decisions. The 
situation in many colleges has been characterized aptly by 
Elizabeth May: 

In almost every college I know there have 
been some courageous members who have 
been saying that the methods we were using 
were not certain to accomplish our purpose. 
(However) those few hardy souls who tried to 
measure have found themselves chewing on 
very dry toast. I think that I may safely say 
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that they have bloodied their heads against 
just as stony a wall as I have. In trying to see 
what has happened to us since just before the 
last war, what do we have to look at? Median 
verbal aptitude, mathematical aptitude and 
English composition! I have a mass of 
interview notes on the problems I have known 
about for 15 years; but how can I summarize 
what they mean in terms of how our 
incoming population has changed, what we 
have accomplished with our product or what 
our product has accomplished with itself. 3 

Those of us who propose that colleges and universities 
should introduce and support educational research programs 
may well ask why our institutions do not have a research 
basis for decision making in academic affairs. Why, as some 
observers have suggested, have institutional research 
approaches contributed to the orderly and efficient 
management of nonacademic affairs while failing to make a 
significant impact on the course of academic life and 
academic decision making? Why, despite rather consistent 
promotion and encouragement of educational research by 
external agencies, does the implementation of educational 
research tend to remain a peripheral concern on our 
respective campuses? 

Factors Militating Against Research 

Examination of such questions, I believe, can be more than 
an academic exercise. First of all, thorough analysis of these 
questions should engender a healthy degree of humility; 
second, but no less important, such an analysis can lead to 
the identification of some of the conceptual and practical 
factors which have militated against establishment of 
educational institutional research and development as a 
recognized function on our campuses. 

I would like to share with you tonight some thoughts 
about a few of these factors and their implications for us. 

3 Elizabeth May, "The College Research Center," in College Entrance 
Examination Board, Retearch in Higher Education (N. Y.: The Board, 1965), pp. 
9-15. 
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We may begin our examination by recognizing that 
conventional methods have some merit! One factor which has 
deterred the adoption of formal, organized methods of 
inquiry addressed to educational questions is the fact that 
traditional, informal methods have not prevented colleges 
from carrying out their academic functions, with some degree 
of success and with minimal challenge to budget or 

established ways of thinking and doing business. 

Questions which pertain to the nature of collegiate 
institutions, the characteristics of students, the conditions of 
faculty service, the outcomes of education and the 
interrelationship of various facts about these 
circumstances-questions of genuine significance-as Mayhew 
has noted, are answered conventionally in a variety of ways, 
including sheer logic from some stated or assumed absolute 
premise; hunch or insight based on fugitive information or 
evidence; discussion of committees and informal groups; and 
inferences by some strategically placed individual based on 

accumulated data or observation. 

All these modes are now in use. They are efficacious to 
some degree, and they serve in lieu of more systematic 
research approaches. Mayhew asserts that discussion of 
educational research should be concerned with the question 
of whether or not and in what circumstances research can 
validly provide better answers than those provided by 
conventional methods.^ The selection of techniques should, 
of course, be guided by analysis of the problem. However, I 
would assert that formal research procedures should be 
thought of as paralleling and interacting with conventional 
procedures, not as a substitute for them; but I would also 
emphasize that the reverse is equally true: Formal 
structuring of experience is a necessary precondition to its 
systematic evaluation. Conventional procedures lack this 

essential quality. . 

Of course, continued reliance on informal, conventional 

procedures in dealing with educational questions is due only 
in part to the fact that such procedures are at least minimally 
adequate. It may be hypothesized that members of a college 

4 Lewis Mayhew, "Educational Research, Its Capabilities and Limitations,” in 
CEEB, Retearch in Higher Education , pp. 1-8. 



